Information processing apparatus, information processing method, program, and measuring system

ABSTRACT

There is provided an imaging unit comprising at least one image sensor, a measuring instrument including at least one marker, a position computing unit, a determining unit, and an output controller, wherein the imaging unit is configured to acquire an image comprising a user and the marker, and provide the acquired image to the position computing unit, wherein the position computing unit is configured to compute a position of the marker with respect to the user based on the image provided by the imaging unit, and further provide the computed position to the determining unit, wherein the determining unit is configured to determine whether the computed position of the marker matches a retrieved measurement position, and further output the result of the determination to the output controller, and wherein the output controller is configured to provide an indication when the marker position matches the measurement position.

TECHNICAL FIELD

The present disclosure relates to an information processing apparatus,an information processing method, a program, and a measuring system, andmore particularly, to an information processing apparatus, aninformation processing method, a program, and a measuring system capableof precise fixed point observation.

BACKGROUND ART

In the related art, there exist measuring instruments that measure thestate of a user's skin. By using such a measuring instrument to measurethe same area of skin, for example, a user is able to perform fixedpoint observation of chronological changes in his or her skin state.

However, since the user relies on his or her memory of takingmeasurements to determine the previously measured area and to take ameasurement, it is difficult to precisely observe the same area.

Accordingly, there exists a display recognition method configured tocause a user to recognize a previously measured area by presenting adisplay on a display device that indicates to the user using themeasuring instrument, together with the same area of skin that waspreviously measured (see PTL 1, for example).

CITATION LIST Patent Literature

[PTL 1]

Japanese Unexamined Patent Application Publication No. 2010-284239

SUMMARY OF INVENTION Technical Problem

However, according to the display recognition method of the related art,although the user is able to recognize a previously measured area, it isdifficult to accurately move the measuring instrument to a positionenabling the measurement of that area.

In other words, the user moves the measuring instrument and causes themeasuring instrument to measure his or her skin upon determining thatthe measuring instrument has moved to a position enabling themeasurement of the same area as before, but the position determined bythe user is not strictly limited to being the position enabling themeasurement of the same area as before.

For this reason, it has been difficult to precisely observe the samearea of skin, even in the case of using the display recognition methodof the related art.

The present disclosure has been devised in light of such circumstances,and is capable of precise fixed point observation.

Solution to Problem

A measuring system for performing a fixed point observation according toa first embodiment of the present disclosure includes at least one imagesensor, a measuring instrument including at least one marker, a positioncomputing unit, a determining unit, and an output controller, whereinthe imaging unit is configured to acquire an image comprising a user andthe marker, and provide the acquired image to the position computingunit, wherein the position computing unit is configured to compute aposition of the marker with respect to the user based on the imageprovided by the imaging unit, and further provide the computed positionto the determining unit, wherein the determining unit is configured todetermine whether the computed position of the marker matches aretrieved measurement position, and further output the result of thedetermination to the output controller, and wherein the outputcontroller is configured to provide an indication when the markerposition matches the measurement position.

The measuring system may further include a user identifying unitconfigured to receive an image from the imaging unit, detect one or morefeatures associated with the user, and identify a user based on thedetected one or more features. The retrieved measurement position may bea measurement position associated with the identified user.

The marker may be an LED that emits at least one of visible light,ultraviolet light and infrared light.

The marker may also be a light emitter that blinks in a predeterminedblinking pattern by turning on and off, and the measuring system furtherinclude a pattern detector that detects the blinking pattern of themarker on the basis of whether the marker is on or off in the image.

The measuring instrument may further acquire measurement data inresponse to the retrieved measurement position matching the computedposition of the LED.

The measurement data may comprise skin measurement data.

The measuring instrument may measure the user's skin by taking an imagein close proximity, and the measuring system may further include agenerator that, on the basis of a plurality of skin images obtained fromthe measurement unit, generates a full skin image formed by joining theplurality of skin images together.

The measuring system may further include an irradiating unit configuredto successively emit light at different wavelengths. The measuringinstrument may acquire measurement data for each successive lightemission.

The measuring system may further acquire skin measurement data utilizingthe measurement instrument.

The measuring instrument may be freely attachable to and detachable fromthe imaging unit.

The measuring system may further include an orientation identifying unitthat identifies the orientation of the measuring instrument.

The measuring instrument may include a sensor that senses the motion ofthe measuring instrument, and the orientation identifying unitidentifies the orientation of the measuring instrument on the basis ofthe sensing results from the sensor.

The marker may be a graphical figure provided on a case of the measuringinstrument and the orientation identifying unit may identify theorientation of the measuring instrument on the basis of the shape of thegraphical figure in the image.

A method of performing a fixed point observation according to anembodiment of the present disclosure, may include receiving an imagecomprising a user and a measuring unit, determining a position of themeasuring unit based on the received image; retrieving a storedmeasurement position associated with the measuring unit, determining ifthe retrieved measurement position associated with the measuring unitmatches the determined position of the measuring unit, and providing anindication that the retrieved measurement position associated with themeasuring unit matches the determined position of the measuring unit.

The method of performing a fixed point observation may further includeidentifying the user based on the received image, wherein retrieving astored measurement position further comprises retrieving a measurementposition associated with the identified user.

The position of the measuring unit may be determined by calculating aposition of a marker associated with the measuring unit.

The marker may be a light emitter that blinks in a predeterminedblinking pattern by turning on and off, and the method may furtherinclude detecting the blinking pattern of the marker on the basis ofwhether the marker is on or off in the image.

The method of performing a fixed point observation may further includedisplaying an image comprising an image of the user and an image of themeasuring unit to an imaging unit display.

The method of performing a fixed point observation may further acquiremeasure data from the measurement unit in response to an indication thatthe retrieved measurement position associated with the measuring unitmatches the determined position of the measuring unit.

The image may be acquired at an imaging unit and the position of themeasuring unit may be based on a position of an LED associated with themeasuring unit.

The method of performing a fixed point observation may further acquireskin measurement data using the measurement unit.

The measuring unit may measure the user's skin by taking an image inclose proximity and further generate, on the basis of a plurality ofskin images obtained from the measurement unit, a full skin image formedby joining the plurality of skin images together.

The method of performing a fixed point observation may further includeidentifying a state associated with the measuring unit, where the stateof the measuring unit may be at least one of on and off, and displayingthe state of the measuring unit and at least one image.

The method of performing a fixed point observation may further includestoring the determined position of the measuring unit as a newmeasurement position, receiving a second image comprising the user andthe measuring unit, determining the position of the measuring unit basedon the received image, retrieving the new measurement position,determining if the retrieved new measurement position of the measuringunit matches the determined position of the measuring unit, andproviding an indication that the retrieved new measurement position ofthe measuring unit matches the determined position of the measuringunit.

The method of performing a fixed point observation may further includereceiving depth information indicating positions in a depth direction,receiving measurement information from the measurement unit, themeasurement information comprising skin image data, and generating athree-dimensional image map based on the received depth information andthe received measurement information.

The method of performing a fixed point observation may further includereceiving measurement information corresponding to different wavelengthsof light.

A method of performing a fixed point observation according to at leastone embodiment of the present disclosure may comprise determining aposition of a measuring instrument based on an image of the measuringinstrument, and initiating a measurement by the measuring instrumentwhen the position of the measuring instrument matches a retrievedmeasurement position.

The measurement by the measuring instrument may be skin measurementdata.

The determined position of the measuring instrument maybe based on aposition of the measuring instrument in an image in relation to a userin the image.

Advantageous Effects of Invention

According to the present disclosure, precise fixed point observationbecomes possible.

BRIEF DESCRIPTION OF DRAWINGS

[FIG. 1]

FIG. 1 is a diagram illustrating an exemplary configuration of ameasuring system in the present disclosure.

[FIG. 2]

FIG. 2 is a block diagram illustrating a first exemplary configurationof the smartphone in FIG. 1.

[FIG. 3]

FIG. 3 is a flowchart for illustrating a reporting process conducted bythe smartphone in FIG. 2.

[FIG. 4]

FIG. 4 is a block diagram illustrating a second exemplary configurationof the smartphone in FIG. 1.

[FIG. 5]

FIG. 5 is a flowchart for illustrating a state displaying processconducted by the smartphone in FIG. 4.

[FIG. 6]

FIG. 6 is a block diagram illustrating a third exemplary configurationof the smartphone in FIG. 1.

[FIG. 7]

FIG. 7 is a flowchart for illustrating a measurement controlling processconducted by the smartphone in FIG. 6.

[FIGS. 8A-8B]

FIGS. 8A-8B each show a diagram illustrating an example of how ameasuring instrument measures multiple skin images.

[FIG. 9]

FIG. 9 is a flowchart for illustrating an image compositing processconducted by the smartphone in FIG. 6.

[FIG. 10]

FIG. 10 is a diagram illustrating an example of a jacket-style measuringinstrument.

[FIG. 11]

FIG. 11 is a diagram illustrating an example of a jacket-style measuringinstrument attached to a smartphone.

[FIG. 12]

FIG. 12 is a diagram illustrating an example of causing a jacket-stylemeasuring instrument to measure skin data while attached to asmartphone.

[FIG. 13]

FIG. 13 is a diagram illustrating an example of using a measuringinstrument and a smartphone as a magnifying glass.

[FIG. 14]

FIG. 14 is a diagram illustrating an example of a measuring instrumentwith improved usability.

[FIG. 15]

FIG. 15 is a block diagram illustrating an exemplary hardwareconfiguration of a computer.

DESCRIPTION OF EMBODIMENTS

Hereinafter, embodiments for carrying out the present disclosure(hereinafter designated embodiments) will be described. The descriptionwill proceed in the following order.

1. First embodiment (example of reporting when LED position matchesmeasurement position)

2. Second embodiment (example of displaying state of measuringinstrument according to LED blinking pattern)

3. Third embodiment (example of performing measurement when LED positionmatches measurement position)

4. Modifications

1. First Embodiment

Exemplary Configuration Of Measuring System 1

FIG. 1 illustrates an exemplary configuration of a measuring system 1 inthe present disclosure.

The measuring system 1 includes a measuring instrument 21 and asmartphone 22, for example, and is capable of performing fixed pointobservation of skin data regarding a user's skin with the measuringinstrument 21.

Note that although the measuring system 1 is described as a system thatperforms fixed point observation of skin data in the present disclosure,the target of fixed point observation is not limited to skin data, anddata regarding features such as the scalp and hair roots, or dataexpressing the extent (degree) of deterioration in a work of art such asa sculpture, may also be targeted.

The measuring instrument 21 is moved in close proximity to the user'sskin (the user's face, for example), and measures skin data regardingthe user's skin. Herein, close proximity designates a concept thatincludes both contact, which represents a distance of zero to the user'sskin, and nearness, which represents a short distance to the user'sskin.

Also, the data adopted as skin data may be data expressing the state ofthe user's skin (numerical data indicating factors such as skinelasticity and looseness), or data used to determine the state of theuser's skin (a skin image obtained by imaging the skin, for example).

Note that in the first embodiment, the measuring instrument 21 includesa built-in camera 21 a that takes a close-up image of the user's skin,and will be described as an instrument that uses the built-in camera 21a to measure skin data in the form of a skin image. However, the skindata measuring method by the measuring instrument 21 is not limited to ameasuring method using the camera 21 a, and may be any measuring methodcapable of measuring skin data.

Also, in the measuring instrument 21, a light-emitting diode (LED) 21 bis provided on the back of the measuring instrument 21 (the face on theopposite of the face in close proximity to the user's skin). The LED 21b turns on to allow the smartphone 22 to identify the position of themeasuring instrument 21.

Note that although the LED 21 b is provided on the measuring instrument21, the marker is not limited to the LED 21 b insofar as the markerallows the smartphone 22 to identify the position of the measuringinstrument 21, and any such marker may be provided. For example, agraphical figure such as a two-dimensional barcode may be implemented asa marker.

The smartphone 22 includes an imaging unit 22 a that takes an image ofthe user as well as the LED 21 b as subjects, and a liquid crystaldisplay (LCD) 22 b that displays information such as an image obtainedfrom imaging by the imaging unit 22 a.

Note that the LED 21 b turns on by emitting light at a wavelength ableto be sensed (recognized) by the imaging unit 22 a. Besides visiblelight, the LED 21 b may also be configured to emit invisible light suchas ultraviolet or infrared light, in order to avoid glare caused by theLED 21 b. This similarly applies to the case where the LED 21 b blinks,as discussed later with FIGS. 4 and 5.

As illustrated in FIG. 1, with the measuring instrument 21 in a state ofclose proximity to the face, the user moves the measuring instrument 21while referring to an image displayed on the LCD 22 b of the smartphone22.

On the basis of the image obtained from the imaging unit 22 a, thesmartphone 22 determines whether or not the position of the LED 21 bwith respect to the user (the LED position) is a measurement positionrepresenting the position of the LED when performing a measurement withthe measuring instrument 21.

The smartphone 22 then conducts a reporting process that reports in thecase of determining that the LED position is the measurement position,for example. At this point, the user is able to perform fixed pointobservation of the same area on his or her face by operating themeasuring instrument 21 and causing the measuring instrument 21 to takea measurement.

In other words, the measuring instrument 21 is able to continuallymeasure a skin image of the same area on the user's face.

Note that the reporting process conducted by the smartphone 22 will bediscussed in detail with reference to FIGS. 2 and 3. The smartphone 22also conducts processes different from the reporting process, and theseprocesses will be described with FIG. 4 and subsequent drawings.

Next, FIG. 2 illustrates a first exemplary configuration of thesmartphone 22 in FIG. 1.

Besides the imaging unit 22 a and the LCD 22 b, the smartphone 22 inFIG. 2 includes a user identifying unit 61, a position computing unit62, a determining unit 63, an output controller 64, a speaker 65, adisplay controller 66, a main controller 67, and an operable unit 68.

Note that the imaging unit 22 a takes an image of the user and the LED21 b of the measuring instrument 21, and supplies the image obtained bysuch imaging to the user identifying unit 61, the position computingunit 62, and the display controller 66.

The imaging unit 22 a includes optics 41, an image sensor 42, and asignal processing integrated circuit (IC) 43.

The optics 41 include components such as a lens that condenses incidentlight (such as reflected light from the user, for example), and adiaphragm (not illustrated) that adjusts the amount of incident light.The optics 41 focus the incident light onto the light-sensing face ofthe image sensor 42.

The image sensor 42 photoelectrically converts the light focused by theoptics 41, and outputs an image signal obtained as a result to signalprocessing IC 43. Note that an image sensor such as a charge-coupleddevice (CCD) or complementary metal-oxide-semiconductor (CMOS) imagesensor may be implemented as the image sensor 42, for example.

The signal processing IC 43 subjects the image signal from the imagesensor 42 to image processing, and supplies an image expressing theprocessed image signal to the user identifying unit 61, the positioncomputing unit 62, and the display controller 66.

The user identifying unit 61 identifies the user as an imaged subject onthe basis of the image from the imaging unit 22 a.

In other words, the user identifying unit 61 detects features such asthe user's face from the image from the imaging unit 22 a, andidentifies the user on the basis of the detection results, for example.The user identifying unit 61 then supplies the identification result tothe determining unit 63.

Note that a method that detects skin color portions from the entireimage area as the user's face may be implemented as the method ofdetecting features such as the user's face, for example.

The position computing unit 62 computes the position of the LED 21 bwith respect to the user (the LED position) on the basis of the imagefrom the imaging unit 22 a, and supplies the computed LED position tothe determining unit 63.

In other words, the position computing unit 62 detects regions of skincolor from the image from the imaging unit 22 a as the user's face, andin addition, detects a region of luma equal to or greater than apredetermined threshold as the turned-on LED 21 b, for example. Notethat the LED 21 b is turned on by the measuring instrument 21 in orderto compute the LED position.

The position computing unit 62 then computes the LED position on thebasis of the detection results for the user's face and the LED 21 b, andsupplies the computed LED position to the determining unit 63.

The determining unit 63 includes built-in memory 63 a. The memory 63 astores measurement positions in association with each of multipledifferent users. Herein, a measurement position refers to the LEDposition when measuring the same area with the measuring instrument 21for fixed point observation. The LED position from a previousmeasurement by the measuring instrument 21 may be adopted as themeasurement position, for example.

Note that the memory 63 a may be configured to store multiple positionsrather than one position as the measurement position.

In other words, in the case where the measurement region representingthe area measured by the measuring instrument 21 is a small region ableto be measured with a single measurement, one measurement positionmeasuring that region is stored.

Meanwhile, in the case where the measurement region is a large regioninvolving multiple measurements, as with the measurement region 121illustrated in FIG. 8 discussed later, multiple measurement positionsmeasuring that region are stored.

Note that in the case where only one user uses the measuring instrument21, the memory 63 a may store only a measurement position for that user.In this case, the user identifying unit 61 may be omitted from thesmartphone 22 in FIG. 2.

On the basis of an identification result from the user identifying unit61, the determining unit 63 retrieves a measurement position associatedwith the user identified by the user identifying unit 61 from the memory63 a.

The determining unit 63 then determines whether or not the LED positionfrom the position computing unit 62 matches the measurement positionretrieved from the memory 63 a, and if matching, reports the result tothe output controller 64.

In response to receiving a report from the determining unit 63, theoutput controller 64 controls the speaker 65, causing the speaker 65 tooutput a tone indicating that the LED position matches the measurementposition.

Note that in the first embodiment, in the case where the LED positionmatches the measurement position, the smartphone 22 in FIG. 2 reportsthe result to the user by outputting a tone from the speaker 65.However, the reporting method is not limited thereto.

In other words, the smartphone 22 in FIG. 2 may also use at least one ofthe speaker 65 and the LCD 22 b, for example, to report to the user thatthe LED position matches the measurement position.

In the case of displaying that the LED position matches the measurementposition on the LCD 22 b, the display controller 66 controls the LCD 22b in response to receiving a report from the determining unit 63, andcauses the LCD 22 b to display a display indicating that the LEDposition matches the measurement position.

This case assumes that in the case where the LED position matches themeasurement position, the determining unit 63 reports the result to thedisplay controller 66.

The speaker 65 outputs a tone under control by the output controller 64,for example. Note that since the first embodiment is described takingthe smartphone 22 as an example, the speaker 65 is configured as part ofthe smartphone 22. However, the speaker 65 may also be providedexternally. Similar reasoning also applies to the LCD 22 b.

The display controller 66 supplies an image from the imaging unit 22 ato the LCD 22 b for display. Thus, an image depicting the user togetherwith the measuring instrument 21 is displayed on the LCD 22 b, asillustrated in FIG. 1.

As another example, the display controller 66 may also superimpose aposition display representing the measurement position onto an imagefrom the imaging unit 22 a, and cause the LCD 22 b to display thesuperimposed image.

In this case, the LED 21 b of the measuring instrument 21 and theposition display are displayed on the LCD 22 b. The user then moves themeasuring instrument 21 to align the LED 21 b of the measuringinstrument 21 with the position display while referring to the displayscreen on the LCD 22 b.

Thus, the user becomes able to more rapidly perform fixed pointobservation with the measuring instrument 21 compared to the case wherea position display is not displayed on the LCD 22 b.

As another example, in the case where the measurement target of themeasuring instrument 21 is a large region involving multiplemeasurements as with the measurement region 121 illustrated in FIG. 8discussed later, for example, the display controller 66 maydifferentiate the display of measured areas and unmeasured areas in themeasurement region 121.

In this case, the user is able to easily ascertain the measured areasand the unmeasured areas by referring to the LCD 22 b, therebypreventing missed measurements with the measuring instrument 21.

Otherwise, the display controller 66 may also ignore (discard) an imagefrom the imaging unit 22 a and not display an image on the LCD 22 b, forexample.

The main controller 67 controls the imaging unit 22 a, the useridentifying unit 61, the position computing unit 62, the determiningunit 63, the output controller 64, and the display controller 66 on thebasis of an operation signal from the operable unit 68, for example.

The operable unit 68 includes elements such as operable buttons operatedby the user, and in response to being operated by the user, supplies themain controller 67 with an operation signal corresponding to the useroperation. Note that the operable unit 68 may also be provided on theLCD 22 b as a touch panel that senses touch operations from the user.

<Behavior of Smartphone 22 in FIG. 2>

Next, a reporting process conducted by the smartphone 22 in FIG. 2 willbe described with reference to the flowchart in FIG. 3.

The reporting process starts when, for example, the user uses theoperable unit 68 to perform an activation operation that activates anapplication that executes the reporting process.

At this point, the operable unit 68 supplies the main controller 67 withan operation signal corresponding to the user's activation operation.The main controller 67 controls the imaging unit 22 a, the useridentifying unit 61, the position computing unit 62, the determiningunit 63, the output controller 64, and the display controller 66 on thebasis of the operation signal from the operable unit 68.

Note that the LED 21 b is assumed to be turned on when executing thereporting process.

In step S21, the imaging unit 22 a, under control by the main controller67, takes an image of the user and the LED 21 b, and supplies the imageobtained by such imaging to the user identifying unit 61, the positioncomputing unit 62, and the display controller 66.

In step S22, the user identifying unit 61 identifies the user as animaged subject on the basis of the image from the imaging unit 22 a, andsupplies the identification result to the determining unit 63.

In step S23, the position computing unit 62 computes the position of theLED 21 b with respect to the user as the LED position on the basis ofthe image from the imaging unit 22 a, and supplies the computed LEDposition to the determining unit 63.

In step S24, the determining unit 63, on the basis of the identificationresult from the user identifying unit 61, retrieves a measurementposition associated with the user identified by the processing in stepS22 from the internal memory 63 a.

The determining unit 63 then determines whether or not the LED positionfrom the position computing unit 62 matches the measurement positionretrieved from the memory 63 a, and if matching, reports the result tothe output controller 64, and the process advances to step S25.

In step S25, the output controller 64, in response to receiving a reportfrom the determining unit 63, controls the speaker 65, causing thespeaker 65 to output a tone indicating that the LED position matches themeasurement position.

Note that in the case where the determining unit 63 determines in stepS24 that the LED position from the position computing unit 62 does notmatch the measurement position retrieved from the memory 63 a, theprocess skips step S25 and advances to step S26.

In step S26, the display controller 66 supplies an image from theimaging unit 22 a to the LCD 22 b for display. Thus, an image depictingthe user together with the measuring instrument 21 is displayed on theLCD 22 b, as illustrated in FIG. 1.

In step S27, the imaging unit 22 a takes an image of the user and theLED 21 b of the measuring instrument 21, and supplies the image obtainedby such imaging to the user identifying unit 61, the position computingunit 62, and the display controller 66, similarly to the case of stepS21. After that, the process returns to step S23, and similar processingis conducted thereafter.

Note that the reporting process ends when, for example, the user usesthe operable unit 68 to perform an operation that ends the applicationthat executes the reporting process.

According to the reporting process as described above, in the case wherethe LED position matches the measurement position, the output controller64 controls the speaker 65 to output a tone indicating the result, forexample.

Thus, the user is able to easily recognize that the LED position matchesthe measurement position by the tone from the speaker 65.

Consequently, by pressing a measure button (not illustrated) causing themeasuring instrument 21 to take a measurement when the speaker 65outputs a tone, the user is able to repeatedly cause the measuringinstrument 21 to measure skin data from the same area of the user'sface.

Thus, the user becomes able to perform fixed point observation of thesame area of the user's face using the measuring instrument 21.

Also, since the user may cause the measuring instrument 21 to take askin measurement only when the speaker 65 outputs a tone, it is possibleto reduce power consumption compared to the case of causing themeasuring instrument 21 to continually take skin measurements.

Meanwhile, although the LED 21 b is configured to be continuously onwhen executing the reporting process in the first embodiment, themeasuring instrument 21 may also be configured to make the LED 21 bblink in a blinking pattern that indicates the start of a skin datameasurement, for example.

In this case, the smartphone 22 detects the blinking pattern of the LED21 b on the basis of the LED 21 b being on or off in images obtainedfrom the imaging unit 22 a, and conducts a state displaying process thatdisplays on the LCD 22 b the state of the measuring instrument 21 asindicated by the detected blinking pattern. The state displaying processwill be described in detail with reference to FIGS. 4 and 5 as thesecond embodiment.

Herein, states such as the measurement progress state and the imagingstate of the camera 21 a built into the measuring instrument 21 may beadopted as states of the measuring instrument 21, for example.

Note that the measurement progress state may be considered to be a stateindicating that measurement is starting, a state indicating that skindata is being measured, or a state indicating that measurement isending, for example.

Meanwhile, in the case where the camera 21 a operates in multipleoperating modes, the imaging state of the camera 21 a may be consideredto be a state indicating an operating mode that takes an image of skinilluminated with visible light, or a state indicating an operating modethat takes an image of skin illuminated with infrared light, forexample.

2. Second Embodiment

Exemplary Configuration of Smartphone 22 According to Second Embodiment

Next, FIG. 4 illustrates an exemplary configuration of a smartphone 22able to display an image with a superimposed state display.

Note that in the smartphone 22 in FIG. 4, portions configured similarlyas in the case of FIG. 2 are denoted with the same reference signs, andthe description of such portions may be reduced or omitted hereinafter.

In other words, the smartphone 22 in FIG. 4 is configured similarly asin the case of FIG. 2, except that a pattern detector 81, a stateidentifying unit 82, and a display controller 83 are provided instead ofthe display controller 66 in FIG. 2.

The pattern detector 81 is supplied with images from the imaging unit 22a. The pattern detector 81 detects whether the LED 21 b is on or off, onthe basis of the images supplied from the imaging unit 22 a.

In other words, the pattern detector 81 detects that the LED 21 b is onin the case where luma equal to or greater than a predeterminedthreshold exists among the respective luma values in an image from theimaging unit 22 a, and detects that the LED 21 b is off in the casewhere luma equal to or greater than the threshold does not exist.

The pattern detector 81 then supplies the state identifying unit 82 withmultiple detection results obtained from the respective images suppliedby the imaging unit 22 a as the blinking pattern of the LED 21 b,together with the images.

The state identifying unit 82 identifies the state of the measuringinstrument 21 on the basis of the blinking pattern from the patterndetector 81, and supplies the display controller 83 with theidentification result, together with the images from the patterndetector 81.

In other words, the state identifying unit 82 determines whether or notthe blinking pattern from the pattern detector 81 matches a statepattern representing the state of the measuring instrument 21, forexample.

Then, in the case of determining that the blinking pattern does notmatch a state pattern, the state identifying unit 82 supplies thedisplay controller 83 with only the images from the pattern detector 81.

Meanwhile, in the case of determining that the blinking pattern doesmatch a state pattern, the state identifying unit 82 identifies thestate indicated by that state pattern as the state of the measuringinstrument 21, and supplies the display controller 83 with theidentification result, together with the images from the patterndetector 81.

Note that the state identifying unit 82 stores multiple different statepatterns in advance in internal memory not illustrated.

The display controller 83 supplies an image from the state identifyingunit 82 to the LCD 22 b for display, similarly to the display controller66 in FIG. 2.

Also, in the case where the state identifying unit 82 supplies anidentification result indicating the state of the measuring instrument21, the display controller 83 superimposes a state display indicatingthe state of the measuring instrument 21 onto an image from the stateidentifying unit 82 on the basis of the identification result.

The display controller 83 then supplies the image with the superimposedstate display to the LCD 22 b for display.

<Behavior of Smartphone 22 in FIG. 4>

Next, a state displaying process conducted by the smartphone 22 in FIG.4 will be described with reference to the flowchart in FIG. 5.

Note that the smartphone 22 in FIG. 4 conducts a process similar to thereporting process conducted by the smartphone 22 in FIG. 2, except forconducting the state displaying process instead of the processing instep S26 of FIG. 3. For this reason, the flowchart in FIG. 5 onlyillustrates the state displaying process.

In step S41, the pattern detector 81 detects whether the LED 21 b is onor off, on the basis of images supplied from the imaging unit 22 a.

In other words, the pattern detector 81 detects that the LED 21 b is onin the case where luma equal to or greater than a predeterminedthreshold exists among the respective luma values in an image from theimaging unit 22 a, and detects that the LED 21 b is off in the casewhere luma equal to or greater than the threshold does not exist.

The pattern detector 81 then supplies the state identifying unit 82 withmultiple detection results obtained from respective images supplied bythe imaging unit 22 a as the blinking pattern of the LED 21 b, togetherwith the images.

In step S42, the state identifying unit 82 determines whether or not theblinking pattern from the pattern detector 81 matches a state patternrepresenting the state of the measuring instrument 21.

Then, in the case of determining that the blinking pattern does notmatch a state pattern, the state identifying unit 82 supplies thedisplay controller 83 with only the images from the pattern detector 81,and the process advances to step S43.

In step S43, the display controller 83 supplies an image from the stateidentifying unit 82 to the LCD 22 b for display as-is, and the statedisplaying process ends.

Meanwhile, in the case where the state identifying unit 82 determines instep S42 that the blinking pattern does match a state pattern, theprocess advances to step S44, and the state identifying unit 82identifies the state indicated by that state pattern as the state of themeasuring instrument 21.

The state identifying unit 82 then supplies the display controller 83with the identification result together with the images from the patterndetector 81, and the process proceeds to step S45.

In step S45, the display controller 83 superimposes a state displayindicating the state of the measuring instrument 21 onto an image fromthe state identifying unit 82, on the basis of the identification resultindicating the state of the measuring instrument 21 from the same stateidentifying unit 82.

The display controller 83 then supplies the image with the superimposedstate display to the LCD 22 b for display, and the state displayingprocess ends.

According to the state displaying process as described above, thedisplay controller 83 causes the LCD 22 b to display the state of themeasuring instrument 21 on the basis of a blinking pattern by the LED 21b of the measuring instrument 21.

Thus, the user becomes able to easily ascertain the state of themeasuring instrument 21 (such as a state where the measuring instrument21 is taking a measurement, for example) by referring to the LCD 22 b ofthe smartphone 22 in FIG. 4.

Note that the smartphone 22 may be configured such that, in the case ofdetermining that the LED position is the measurement position, thesmartphone 22 controls the measuring instrument 21 and conducts ameasurement controlling process that causes the measuring instrument 21to take a skin measurement. The measurement controlling process will bedescribed in detail with reference to FIGS. 6 and 7 as the thirdembodiment.

3. Third Embodiment

Exemplary Configuration of Smartphone 22 According to Third Embodiment

Next, FIG. 6 illustrates an exemplary configuration of a smartphone 22that controls the measuring instrument 21 to measure skin data.

Note that in the smartphone 22 in FIG. 6, portions configured similarlyas in the case of FIG. 2 are denoted with the same reference signs, andthe description of such portions may be reduced or omitted hereinafter.

In other words, the smartphone 22 in FIG. 6 is configured similarly asin the case of FIG. 2, except that a communication controller 101, acommunication unit 102, and a data storage unit 103 are additionallyprovided.

Also, in the third embodiment, the display controller 66 in FIG. 6 maybe configured to function as the pattern detector 81, the stateidentifying unit 82, and the display controller 83 in FIG. 4.

In other words, in the third embodiment, with the configurationillustrated in FIG. 6, the smartphone 22 in FIG. 6 is able to conduct atleast one of a reporting process similar to the smartphone 22 in FIG. 2or the measurement controlling process in the case where the LEDposition matches the measurement position.

Furthermore, if the display controller 66 in FIG. 6 is configured tofunction as the pattern detector 81 to the display controller 83 in FIG.4, the smartphone 22 in FIG. 6 is able to conduct at least one of areporting process similar to the smartphone 22 in FIG. 2 or themeasurement controlling process in the case where the LED positionmatches the measurement position.

Also, in FIG. 6, besides the camera 21 a and the LED 21 b, the measuringinstrument 21 is provided with a communication unit 21 c that wirelesslycommunicates with the smartphone 22.

Note that although the third embodiment describes the measuringinstrument 21 and the smartphone 22 communicating wirelessly, themeasuring instrument 21 and the smartphone 22 may also be connected by acable and communicate via the cable.

The communication controller 101 controls the communication unit 102 andcommunicates data with the measuring instrument 21 by wirelesscommunication such as Wi-Fi (trademark) or Bluetooth (registeredtrademark).

In other words, the communication controller 101 controls thecommunication unit 102 to transmit a control signal to the measuringinstrument 21, and receive skin data (a skin image, for example) fromthe measuring instrument 21, for example.

Specifically, in response to a report from the user identifying unit 61or a report from the determining unit 63, the communication controller101 may supply a control signal for controlling the measuring instrument21 to the communication unit 102 for transmission, for example.

Note that the user identifying unit 61 is assumed to report to thecommunication controller 101 in the case of identifying a user as animaged subject, while the determining unit 63 is assumed to report tothe communication controller 101 in the case of determining that the LEDposition matches a measurement position.

Herein, signals such as an ON instruction signal instructing the LED 21b to turn on, an OFF instruction signal instructing the LED 21 b to turnoff, and a measure instruction signal instructing the measuringinstrument 21 to take a measurement may be adopted as a control signal,for example.

As another example, the communication controller 101 may receive a skinimage, for example, as skin data from the measuring instrument 21 viathe communication unit 102, and cause the data storage unit 103 to storethe skin image in association with an LED position from the determiningunit 63.

Note that the determining unit 63 is assumed to supply the communicationcontroller 101 with an LED position from the position computing unit 62.

Also, a skin image stored in the data storage unit 103 may be analyzedby analysis software or the like that determines the state of a user'sskin, for example. Such analysis software or the like is executed by themain controller 67 in response to a user operation performed using theoperable unit 68, for example. Analysis results obtained by the analysissoftware or the like may be displayed on the LCD 22 b, for example.

The communication unit 102, under control by the communicationcontroller 101, transmits information such as a control signal from thecommunication controller 101 to the measuring instrument 21 by wirelesscommunication, and in addition, receives information such as a skinimage from the measuring instrument 21, which is supplied to thecommunication controller 101.

The data storage unit 103 stores (retains) skin images from thecommunication controller 101 which are associated with LED positions.

<Behavior of Smartphone 22 in FIG. 6 According to Third Embodiment>

Next, a measurement controlling process conducted by the smartphone 22in FIG. 6 will be described with reference to the flowchart in FIG. 7.

Note that besides conducting a reporting process similar to that of thesmartphone 22 in FIG. 2, the smartphone 22 in FIG. 6 conducts ameasurement controlling process as a process different from that of thesmartphone 22 in FIG. 2.

In step S61, the communication controller 101 waits for a reportidentifying a user from the user identifying unit 61, and the processthen proceeds to step S62.

In step S62, the communication controller 101 controls the measuringinstrument 21 via the communication unit 102, and turns on the LED 21 bof the measuring instrument 21.

In other words, the communication controller 101 supplies thecommunication unit 102 with an ON instruction signal instructing the LED21 b of the measuring instrument 21 to turn on, for example. Thecommunication controller 101 then controls the communication unit 102 totransmit the ON instruction signal from the communication unit 102 tothe measuring instrument 21.

Thus, the communication unit 21 c in the measuring instrument 21receives an ON instruction signal from the communication unit 102. Acontroller (not illustrated) in the measuring instrument 21 thencontrols the LED 21 b to turn on the LED 21 b on the basis of the ONinstruction signal received by the communication unit 21 c.

In step S63, the communication controller 101 waits for a report fromthe determining unit 63 indicating that the LED position matches ameasurement position, and the process then proceeds to step S64.

In step S64, the communication controller 101 controls the measuringinstrument 21 via the communication unit 102 to measure a skin image,for example.

In other words, the communication controller 101 supplies thecommunication unit 102 with a measure instruction signal instructing themeasuring instrument 21 to take a measurement, for example. Thecommunication controller 101 then controls the communication unit 102 totransmit the measure instruction signal from the communication unit 102to the measuring instrument 21.

Thus, the communication unit 21 c in the measuring instrument 21receives a measure instruction signal from the communication unit 102.Then, on the basis of the measure instruction signal received by thecommunication unit 21 c, a controller (not illustrated) in the measuringinstrument 21 controls the camera 21 a to take an image of the user'sskin and transmit the skin image obtained by such imaging to thecommunication unit 102 via the communication unit 21 c.

In step S65, the communication unit 102 receives a skin image from thecommunication unit 21 c of the measuring instrument 21, which issupplied to the communication controller 101.

In step S66, the communication controller 101 stores the skin image fromthe communication unit 102 in the data storage unit 103, for example, inassociation with the LED position from the determining unit 63. Notethat the determining unit 63 supplies the communication controller 101with the LED position output from the position computing unit 62.

At this point, the skin image stored in the data storage unit 103 may beanalyzed by analysis software or the like that determines the state ofthe user's skin, for example. The analysis results may then be displayedon the LCD 22 b, for example.

In step S67, the communication controller 101 controls the measuringinstrument 21 via the communication unit 102, and turns off the LED 21 bof the measuring instrument 21.

In other words, the communication controller 101 supplies thecommunication unit 102 with an OFF instruction signal instructing theLED 21 b of the measuring instrument 21 to turn off, for example. Thecommunication controller 101 then controls the communication unit 102 totransmit the OFF instruction signal from the communication unit 102 tothe measuring instrument 21.

Thus, the communication unit 21 c in the measuring instrument 21receives an OFF instruction signal from the communication unit 102. Acontroller (not illustrated) in the measuring instrument 21 thencontrols the LED 21 b to turn off the LED 21 b on the basis of the OFFinstruction signal received by the communication unit 21 c. With that,the measurement controlling process ends.

According to the measurement controlling process as described above, inthe case where the LED position matches the measurement position, thecommunication controller 101 controls the measuring instrument 21 viathe communication unit 102, causing the measuring instrument 21 tomeasure a skin image.

Thus, the user is saved the trouble of pressing a measure button (notillustrated) causing the measuring instrument 21 to take a measurement,and is able to repeatedly cause the measuring instrument 21 to measureskin data in the form of a skin image, for example, from the same areaof the user's face.

The measuring instrument 21 measures skin data at an LED position thatmatches a measurement position. However, the measuring instrument 21 mayalso measure skin data at each of multiple different measurementpositions while moving in close proximity to the user's skin, forexample.

In other words, it is possible to measure skin data in the form ofmultiple skin images by having the built-in camera 21 a in the measuringinstrument 21 take an image at each of multiple different measurementpositions.

Next, FIG. 8 illustrates an example of how the measuring instrument 21measures a skin image at each of multiple different measurementpositions while moving in close proximity to the user's skin.

Note that in FIG. 8, the measurement region 121 represents a regionmeasured by the measuring instrument 21, while the skin images 121 a to121 i represent examples of skin images obtained by taking measurementsin the measurement region 121.

Also, in FIG. 8, the track 21 b′ represents the track of the LED 21 bmoving within the measurement region 121 while the measuring instrument21 takes measurements.

Furthermore, in FIG. 8, the full skin image 121′ represents an imageobtained when imaging the measurement region 121. The full skin image121′ is generated by joining the respective skin images 121 a to 121 iillustrated in FIG. 8, for example.

The user moves the measuring instrument 21 such that the LED 21 b tracesthe track 21 b′. In this case, the measuring instrument 21, undercontrol by the smartphone 22 in FIG. 6, measures the skin images 121 ato 121 i at respective measurement positions along the track 21 b′, forexample. The output controller 64 in the smartphone 22 in FIG. 6 mayalso control the speaker 65 to output a tone at each measurementposition along the track 21 b′.

Note FIG. 8 assumes that the user moves the measuring instrument 21 suchthat the LED 21 b traces the track 21 b′. However, the track 21 b′ isnot limited thereto, and may be a track different from a track during aprevious measurement, insofar as the track enables the measuringinstrument 21 to measure the skin images 121 a to 121 i. In other words,features such as the start position and end position of the track 21 b′may differ from a track during a previous measurement.

The measuring instrument 21 transmits the skin images 121 a to 121 iobtained by measurement to the smartphone 22 in FIG. 6.

The smartphone 22 in FIG. 6 receives the skin images 121 a to 121 i fromthe measuring instrument 21, and generates a full skin image 121′ likethat illustrated in FIG. 8 on the basis of the received skin images 121a to 121 i.

<Behavior of Smartphone 22 in FIG. 6 When Generating Full Skin Image>

Next, an image compositing process in which the smartphone 22 in FIG. 6composites the skin images 121 a to 121 i to generate the full skinimage 121′ will be described with reference to the flowchart in FIG. 9.

In step S81 to step S86, processing similar to that in step S61 to stepS66 of FIG. 7 is conducted.

In step S87, the communication controller 101 determines, on the basisof LED positions associated with skin images already stored in the datastorage unit 103, whether or not all skin images to be obtained at therespective measurement positions along the track 21 b′ have beenmeasured, for example.

In step S87, in the case where the communication controller 101determines, on the basis of LED positions associated with skin imagesalready stored in the data storage unit 103, that not all skin images tobe obtained at the respective measurement positions along the track 21b′ have yet been measured, the process returns to step S83.

In step S83, the communication controller 101 determines whether or notthe determining unit 63 has reported that the LED position matches ameasurement position whose skin image has not yet been measured fromamong the respective measurement positions along the track 21 b′.

The communication controller 101 repeats the processing in step S83until determining that the determining unit 63 has reported, and in thecase where the determining unit 63 has reported, the process advances tostep S84, and similar processing is conducted thereafter.

Meanwhile, in step S87, in the case where the communication controller101 determines, on the basis of LED positions associated with skinimages already stored in the data storage unit 103, that all skin imagesto be obtained at the respective measurement positions along the track21 b′ have been measured, the process advances to step S88.

In step S88, the communication controller 101 retrieves from the datastorage unit 103 the skin images 121 a to 121 i that were stored in thedata storage unit 103 by repeating the processing from step S83 to stepS87.

The communication controller 101 then generates a full skin image 121′corresponding to the measurement region 121 on the basis of theretrieved skin images 121 a to 121 i, and supplies the generated fullskin image 121′ to the data storage unit 103 for storage.

In step S89, processing similar to that in step S67 of FIG. 7 isconducted, and the image compositing process ends.

According to the image compositing process as described above, thecommunication controller 101 generates a full skin image 121′corresponding to the measurement region 121 on the basis of skin images121 a to 121 i obtained at respective measurement positions along atrack 21 b′.

Thus, according to the image compositing process, the smartphone 22 inFIG. 6 becomes able to also acquire a full skin image 121′ correspondingto the measurement region 121 that is unfeasible to acquire with asingle measurement.

As another example, if the smartphone 22 in FIG. 6 is provided with adistance measuring unit that measures the distance to a measurementposition on the basis of an image from the imaging unit 22 a, therespective positions of the skin images 121 a to 121 i in the depthdirection (depth information) may also be obtained.

In this case, the smartphone 22 in FIG. 6 is able to generate a fullskin image 121′ as a three-dimensional image with depth information onthe basis of the skin images 121 a to 121 i and the depth information.

In other words, the smartphone 22 in FIG. 6 is able to compute athree-dimensional position for each of the skin images 121 a to 121 ifrom the measurement positions expressed as two-dimensional positions,and the depth information indicating positions in the depth direction,for example.

Thus, by mapping corresponding skin images to the computedthree-dimensional position for each of the skin images 121 a to 121 i,the smartphone 22 in FIG. 6 is able to generate a stereoscopic full skinimage 121′, which may be displayed on the LCD 22 b, for example.

Note that the distance measuring unit is able to measure distanceaccording to the brightness (luma) and size of the LED 21 b in an imageoutput from the imaging unit 22 a, for example. This utilizes the effectof the LED 21 b of the measuring instrument 21 appearing brighter andlarger in an image the closer the LED 21 b is to the smartphone 22 inFIG. 6.

A depth map generator that generates a depth map respectively indicatingthe distance to the subject displayed in each pixel of an image may alsobe adopted as the distance measuring unit, for example.

The depth map generator generates a depth map according to a stereocamera method that uses multiple cameras provided with parallax, or alight-section method that uses a camera and laser slit light, forexample.

As another example, the depth map generator may also generate a depthmap by using a time-of-flight camera, or a laser rangefinder thatmeasures distance according to a principle similar to a time-of-flightcamera.

Herein, a time-of-flight camera refers to a camera which includes alight source that radiates light, and which measures distance on thebasis of the time of flight until light from the light source isreflected back and sensed, and the speed of light.

4. Modifications

Modification of Measuring Instrument 21

The measuring instrument 21 takes a skin image as a measurement of skindata by using a built-in camera 21 a.

However, the measuring instrument 21 may also be provided with anirradiating unit that emits light at different wavelengths, with theirradiating unit successively irradiating the skin with light atdifferent wavelengths. The camera 21 a may then take an image of theskin each time the skin is irradiated with light at a differentwavelength.

In this case, by using the camera 21 a, the measuring instrument 21measures images such as a skin image depicting the epidermis of theskin, a skin image depicting the dermis of the skin, and a skin imagedepicting blood vessels in the skin as different skin images for eachwavelength.

This is because the reflectivity of light differs by wavelength infeatures constituting the skin such as the epidermis, the dermis, andblood vessels. In other words, if for example the irradiating unitradiates light at a wavelength for which the epidermis of the skin hashigh reflectivity but features such as the dermis of the skin and bloodvessels have low reflectivity, the measuring instrument 21 is able tomeasure a skin image depicting the epidermis of the skin (only) byimaging with the camera 21 a.

Thus, the measuring instrument 21 becomes able to measure multiple skinimages for determining various states of the skin.

Note that in the case of providing the measuring instrument 21 with anirradiating unit, the skin image measuring method may conceivably be afirst measuring method that successively drives the irradiating unit andthe camera 21 a, or a second measuring method that drives theirradiating unit and the 21 a in parallel, for example.

In other words, with the first measuring method, the irradiating unitradiates light at a first wavelength, and the camera 21 a images theskin being irradiated with light at the first wavelength, for example.

Next, after stopping the radiation of light at the first wavelength, theirradiating unit radiates light at a second wavelength different fromthe first wavelength, and the camera 21 a images the skin beingirradiated with light at the second wavelength.

Thus, the camera 21 a is able to obtain a skin image of skin beingirradiated with light at a first wavelength, and a skin image of skinbeing irradiated with light at a second wavelength.

Note that in the case where the measuring instrument 21 measures themeasurement region 121, the irradiating unit continues to radiate lightat the first wavelength until the camera 21 a finishes imaging the skinimages 121 a to 121 i within the measurement region 121.

Also, after the camera 21 a finishes imaging the skin images 121 a to121 i, the irradiating unit stops radiating light at the firstwavelength, and starts radiating light at the second wavelength. Theirradiating unit then continues to radiate light at the secondwavelength until the camera 21 a finishes imaging the skin images 121 ato 121 i within the measurement region 121.

Thus, the camera 21 a is able to obtain skin images 121 a to 121 i ofskin being irradiated with light at the first wavelength, and skinimages 121 a to 121 i of skin being irradiated with light at the secondwavelength.

As another example, with the second measuring method, the irradiatingunit successively irradiates skin with light at different wavelengths.Meanwhile, the camera 21 a takes images in parallel with the radiationby the irradiating unit.

Thus, the camera 21 a is able to acquire respective skin images atdifferent wavelengths.

Note that in the case where the measuring instrument 21 measures themeasurement region 121, the user is expected to move the measuringinstrument 21 at a speed enabling skin images 121 a to 121 i to beobtained at different wavelengths.

For this reason, in the case where the user is moving the measuringinstrument 21 too quickly, it is desirable for the smartphone 22 toreport this result to the user, and prompt the user to adjust the speedof the measuring instrument 21, for example. Note that the speaker 65and the LCD 22 b may be used to report to the user.

Also, the smartphone 22 computes the speed of the measuring instrument21 on the basis of at least one of information regarding the change inthe LED position or the motion of the measuring instrument 21.

Herein, information such as the acceleration and angular velocity of themeasuring instrument 21 maybe adopted as motion information. Note thatin the case where the smartphone 22 identifies the speed of themeasuring instrument 21 on the basis of information such as theacceleration and angular velocity of the measuring instrument 21, themeasuring instrument 21 is provided with various sensors (such as anacceleration sensor and an angular velocity sensor (gyro sensor), forexample) that sense information such as the acceleration and angularvelocity of the measuring instrument 21.

The measuring instrument 21 then transmits the sensing results obtainedfrom the various sensors to the smartphone 22 as appropriate. Thesmartphone 22 identifies the speed of the measuring instrument 21 on thebasis of the sensing results from the measuring instrument 21, and inthe case where the identified speed is equal to or greater than a givenspeed, reports to the user by displaying a message or the like on theLCD 22 b indicating that the movement of the measuring instrument 21 istoo fast.

The smartphone 22 is also able to identify the orientation (imagingdirection) of the measuring instrument 21 (camera 21 a) on the basis ofthe sensing results from the measuring instrument 21.

For this reason, the smartphone 22 is able to determine whether or notthe camera 21 a is oriented in accordance with the current LED position(for example, oriented such that the optical axis of the camera 21 a isperpendicular to the skin surface).

In the case of determining that the camera 21 a is not oriented inaccordance with the LED position, the smartphone 22 is able to report tothe user by displaying a message on the LCD 22 b instructing the user tocorrect the orientation of the camera 21 a to an orientation inaccordance with the LED position, for example.

Thus, the user is able to correct the orientation of the camera 21 a toan orientation in accordance with the LED position while referring tothe LCD 22 b of the smartphone 22, thereby making it possible to preventsituations where taking a skin image fails.

Note that although the smartphone 22 is configured to identify theorientation of the camera 21 a on the basis of sensing results from themeasuring instrument 21 as discussed above, the smartphone 22 may alsobe configured to identify the orientation of the camera 21 a on thebasis of an image output from the imaging unit 22 a.

This case assumes that a graphical figure such as a two-dimensionalbarcode is provided on the case of the measuring instrument 21 insteadof the LED 21 b. The smartphone 22 then identifies the orientation ofthe camera 21 a on the basis of the shape of the graphical figure (suchas the deformation of the graphical figure, for example) in an imageoutput from the imaging unit 22 a.

Note that the marker provided on the measuring instrument 21 is notlimited to being a graphical figure such as a two-dimensional barcode,and any marker for the purpose of identifying the orientation of thecamera 21 a may be adopted. In other words, LEDs may also berespectively provided on the top, bottom, left, and right sides of themeasuring instrument 21 instead of a graphical figure such as atwo-dimensional barcode, for example.

The smartphone 22 may also be configured to identify the orientation ofthe camera 21 a on the basis of both sensing results from the measuringinstrument 21 and the shape of a graphical figure in an image outputfrom the imaging unit 22 a. In this case, the smartphone 22 is able tomore precisely identify the orientation of the camera 21 a.

Next, other examples of the measuring instrument 21 will be describedwith reference to FIGS. 10 to 14.

FIG. 10 illustrates an example of a jacket-style measuring instrument21′ which is freely attachable to and detachable from the smartphone 22.

As illustrated in FIG. 10, the measuring instrument 21′ has a shape thatis attachable to the smartphone 22 so as to cover sides of thesmartphone 22, for example. Note that the shape of the measuringinstrument 21′ is not limited to the shape illustrated in FIG. 10, andmay be any shape that is freely attachable to and detachable from thesmartphone 22.

The measuring instrument 21′ is also provided with a camera 21 a, an LED21 b, a communication unit 21 c, and a charging connector 21 d. Notethat the camera 21 a to the communication unit 21 c are configuredsimilarly to the camera 21 a to the communication unit 21 c in FIG. 6,and thus are denoted with the same reference signs, and the descriptionthereof is reduced or omitted.

The charging connector 21 d is a connector provided to charge a battery(not illustrated) built into the measuring instrument 21′.

The measuring instrument 21′ measures a user's skin data similarly tothe measuring instrument 21 illustrated in FIG. 1 when detached from thesmartphone 22 as illustrated in FIG. 10, for example.

Note that the smartphone 22 may be configured to activate an applicationthat conducts processes such as the reporting process in FIG. 3, thestate displaying process in FIG. 5, the measurement controlling processin FIG. 7, and the image compositing process in FIG. 9 in response tothe measuring instrument 21′ being detached.

Next, FIG. 11 illustrates an example of when the measuring instrument21′ is attached to the smartphone 22.

When the measuring instrument 21′ is attached to the smartphone 22, thecharging connector 21 d of the measuring instrument 21′ physicallyconnects to a power supply connector 22 c of the smartphone 22, asillustrated in FIG. 11.

The power supply connector 22 c is a connector provided to supply powerto the measuring instrument 21′, and supplies power to the physicallyconnected charging connector 21 d from a power supply (not illustrated)in the smartphone 22.

Note that in the smartphone 22, the power supply (not illustrated)supplies the power supply connector 22 c with at least one of power froma battery (not illustrated) in the smartphone 22, or power from acharger used to charge the smartphone 22.

The charging connector 21 d charges a battery (not illustrated) builtinto the measuring instrument 21′ by supplying power from the powersupply connector 22 c.

In the case of adopting a jacket-style measuring instrument 21′ that isfreely attachable to and detachable from the smartphone 22 asillustrated in FIG. 11, a user leaving home while carrying thesmartphone 22 will naturally also bring the measuring instrument 21′,thereby making it possible to prevent situations where the user forgetsthe measuring instrument 21′ at home, for example.

Thus, the user is able to use the measuring instrument 21′ to performfixed point observation of his or her skin even when away from home.

Furthermore, since the measuring instrument 21′ is configured to beattached to the smartphone 22 in an integrated way, a user is able tobring along the measuring instrument 21′ and the smartphone 22 withoutfeeling relatively burdened.

In addition, the smartphone 22 is used to take skin measurements inaddition to sending and receiving email and using the phone. For thisreason, the user is freed from taking a device separate from thesmartphone 22, such as a special-purpose display device that displays animage obtained by imaging the user and the LED 21 b, away from home.

Furthermore, since the measuring instrument 21′ is charged by the powersupply (not illustrated) built into the smartphone 22 when the measuringinstrument 21′ is attached to the smartphone 22, it is possible to avoidsituations where the battery in the measuring instrument 21′ runs outwhile away from home.

Thus, it becomes possible to avoid situations where the user becomesunable to take a skin data measurement because the battery in themeasuring instrument 21′ has run out.

Note that if the user uses a mirror when taking a skin data measurementwith the measuring instrument 21′, it is possible to perform fixed pointobservation of skin data even with the measuring instrument 21′ stillattached to the smartphone 22.

Next, FIG. 12 illustrates an example of causing the jacket-stylemeasuring instrument 21′ to measure skin data with the measuringinstrument 21′ still attached to the smartphone 22.

In the case of causing the measuring instrument 21′ to take ameasurement with the measuring instrument 21′ still attached to thesmartphone 22, the user moves the measuring instrument 21′ in closeproximity to his or her face while referring to content displayed on theLCD 22 b and reflected in the mirror.

Thus, the user is able to refer to content displayed on the LCD 22 b ofthe smartphone 22 (such as an image obtained from imaging by the imagingunit 22 a, for example) via the mirror in front of the user, similarlyto the case of the measuring system 1 in FIG. 1.

Also, the imaging unit 22 a built into the smartphone 22 is able toobtain an image similar to the case in FIG. 1 by imaging the userreflected in the mirror as well as the LED 21 b of the measuringinstrument 21′ likewise reflected in the mirror.

Note that even in the case of another measuring instrument in which thepositions of the camera 21 a and the LED 21 b are the reverse of themeasuring instrument 21′ illustrated in FIG. 12, a driving unit able tochange the positions of the camera 21 a and the LED 21 b to positionslike those illustrated in FIG. 12 may be provided.

In this case, the other measuring instrument is able to take a skinmeasurement while still attached to the smartphone 22.

Note that even in the case of inseparably providing the smartphone 22with the measuring instrument 21, such a smartphone 22 may still be usedto take a skin measurement as described with reference to FIG. 12.

Also, the smartphone 22 may be utilized for other uses besides measuringskin data while the measuring instrument 21′ is attached.

Example of Use as Magnifying Glass

Next, FIG. 13 illustrates an example of using the measuring instrument21′ and the smartphone 22 as a magnifying glass.

FIG. 13 illustrates the smartphone 22 displaying an enlarged view of theletters “JKL” from among the letters “ABCDEFGHIJKLMNO” on the LCD 22 b.

Note that FIG. 13 illustrates a state in which only the letters “ABCDEF”from among the letters “ABCDEFGHIJKLMNO” are visible, with the remainingletters “GHIJKLMNO” hidden by the measuring instrument 21′ and thesmartphone 22.

In FIG. 13, the measuring instrument 21′ uses the built-in camera 21 ato take a close-up image of the area showing the letters “JKL”, andsupplies an image obtained by such imaging to the smartphone 22.

The smartphone 22 then enlarges the image from the measuring instrument21′ and displays the enlarged image on the LCD 22 b.

Thus, the measuring instrument 21′ and the smartphone 22 can be used asa magnifying glass, as illustrated in FIG. 12.

Note that the measuring instrument 21′ and the smartphone 22 can be usedas a magnifying glass even when the measuring instrument 21′ is detachedfrom the smartphone 22. In this case, the measuring instrument 21′transmits an image obtained from imaging by the built-in camera 21 a tothe smartphone 22 by wireless communication, for example.

The smartphone 22 may also execute an application for functioning as amagnifying glass in the case where the measuring instrument 21′ isattached, and execute an application for taking a skin measurement inthe case where the measuring instrument 21′ is detached, for example.

Next, FIG. 14 illustrates an example of a measuring instrument 21″ withimproved usability.

As illustrated in FIG. 14, the measuring instrument 21″ has acylindrical shape, and includes a lens barrel 141 and a mode switcher142, for example. Note that although the measuring instrument 21′ isprovided with components such as the camera 21 a and the LED 21 bsimilarly to the measuring instrument 21, these components are omittedfrom illustration to avoid complication in the drawings.

The lens barrel 141 is a cylindrical portion surrounding components suchas the optics of the camera 21 a, and is set to either an OFF state oran ON state, for example. In addition, the lens barrel 141 switches fromthe OFF state to the ON state when depressed by the skin imaged with thecamera 21 a.

In other words, in the case where the measuring instrument 21″ is pushedin the direction of the arrow 161 illustrated in FIG. 14, for example,the lens barrel 141 of the measuring instrument 21″ is depressed by anarea on the user's face (for example, the right cheek in FIG. 14), andswitches to the ON state.

In this case, in response to the lens barrel 141 switching to the ONstate, for example, the camera 21 a takes an image of the skin pressingagainst the measuring instrument 21″ (for example, the right cheek inFIG. 14). In other words, the lens barrel 141 functions as a shutterbutton for the camera 21 a, switching from the OFF state to the ON statewhen the taking an image with the camera 21 a, for example.

Herein, since the direction of the arrow 161 and the imaging direction(optical axis) of the camera 21 a are the same direction, image shake(almost) might not occur when taking an image with the camera 21 a.

Consequently, the measuring instrument 21″ is capable of taking clearskin images without shake.

The mode switcher 142 is freely rotatable about the optical axis of thecamera 21 a in the directions of the arrow 162 and the arrow 163illustrated in FIG. 14, and is operated when switching among variousoperating modes of the measuring instrument 21″.

In other words, if the mode switcher 142 is rotated in the direction ofthe arrow 162, for example, the operating mode of the measuringinstrument 21″ is switched to the previous operating mode. Also, if themode switcher 142 is rotated in the direction of the arrow 163, forexample, the operating mode of the measuring instrument 21″ is switchedto the next operating mode.

Specifically, a first operating mode, a second operating mode, and athird operating mode may exist, for example, and in the case where themeasuring instrument 21″ is in the second operating mode, the operatingmode is switched as follows according to a user switching operation.

Namely, the user is able to simply rotate the mode switcher 142 in thedirection of the arrow 162 to switch the measuring instrument 21″ fromthe second operating mode to the first operating mode.

As another example, the user is able to simply rotate the mode switcher142 in the direction of the arrow 163 to switch the measuring instrument21″ from the second operating mode to the third operating mode.

Thus, the user becomes able to easily switch operating modes withoutfeeling burdened compared to the case of switching the operating mode ofthe measuring instrument 21″ by operating the smartphone 22, forexample.

As another example, since the user is able to switch the operating modeof the measuring instrument 21″ without operating the smartphone 22, itis possible to prevent a situation where the user is distracted byoperating the smartphone 22 and drops the measuring instrument 21″.

Note that modes such as an operating mode when measuring skin on theleft cheek and an operating mode when measuring skin on the right cheekmay be adopted as operating modes of the measuring instrument 21″, forexample.

As another example, by linking to software on the smartphone 22, themeasuring instrument 21″ is able to select and confirm items displayedon the LCD 22 b of the smartphone 22 in response to operations by theuser.

In other words, if the user rotates the mode switcher 142 in thedirection of the arrow 162 on the measuring instrument 21″, the previousitem is selected by a cursor, for example. Also, if the user rotates themode switcher 142 in the direction of the arrow 163, the next item isselected by a cursor, for example.

If the user then pushes the measuring instrument 21″ in the direction ofthe arrow 161, the lens barrel 141 of the measuring instrument 21″ isdepressed. In so doing, the item currently selected by the cursor on thesmartphone 22 is confirmed, and a display corresponding to the confirmeditem is displayed on the LCD 22 b.

Note that in the measuring system 1 in FIG. 1, the LCD 22 b of thesmartphone 22 displays an image obtained from imaging by the imagingunit 22 a, for example.

However, in addition to displaying images that have already been taken,the LCD 22 b may also display a skin image obtained by the camera 21 abuilt into the measuring instrument 21 as a through-the-lens image usedto determine photographic composition.

In this case, the measuring instrument 21 uses wireless communication orthe like to supply the smartphone 22 with a skin image obtained from thecamera 21 a as a through-the-lens image. This applies similarly to thecase of using the measuring instrument 21′ or the measuring instrument21″ instead of the measuring instrument 21 in FIG. 1.

As another example, although the measuring system 1 is made up of ameasuring instrument 21 and a smartphone 22, a device such as a tabletor personal computer may also be adopted instead of the smartphone 22.

Meanwhile, the present technology may take the following configurations.

(1) A method of performing a fixed point observation comprising:receiving an image comprising a user and a measuring unit; determining aposition of the measuring unit based on the received image; retrieving astored measurement position associated with the measuring unit;determining if the retrieved measurement position associated with themeasuring unit matches the determined position of the measuring unit;and providing an indication that the retrieved measurement positionassociated with the measuring unit matches the determined position ofthe measuring unit.

(2) The method of (1), further comprising: identifying the user based onthe received image, wherein retrieving a stored measurement positionfurther comprises retrieving a measurement position associated with theidentified user.

(3) The method of (1), wherein the position of the measuring unit isdetermined by calculating a position of a marker associated with themeasuring unit.

(4) The method of (3), wherein the marker is a light emitter that blinksin a predetermined blinking pattern by turning on and off, the methodfurther comprising detecting the blinking pattern of the marker on thebasis of whether the marker is on or off in the image.

(5) The method of (1), further comprising displaying an image comprisingan image of the user and an image of the measuring unit to an imagingunit display.

(6) The method of (1), further comprising:

in response to the indication that the retrieved measurement positionassociated with the measuring unit matches the determined position ofthe measuring unit, acquiring measurement data from the measurementunit.

(7) The method of (1), wherein the image is acquired at an imaging unit;and wherein the position of the measuring unit is based on a position ofan LED associated with the measuring unit.

(8) The method of (7), further comprising: acquiring skin measurementdata using the measurement unit.

(9) The method of (8), wherein the measuring unit measures the user'sskin by taking an image in close proximity and further generating, onthe basis of a plurality of skin images obtained from the measurementunit, a full skin image formed by joining the plurality of skin imagestogether.

(10) The method of (1), further comprising: identifying a stateassociated with the measuring unit, the state of the measuring unitcomprising at least one of on and off; and displaying the state of themeasuring unit and at least one image.

(11)The method of (1), further comprising: storing the determinedposition of the measuring unit as a new measurement position; receivinga second image comprising the user and the measuring unit; determiningthe position of the measuring unit based on the received image;retrieving the new measurement position; determining if the retrievednew measurement position of the measuring unit matches the determinedposition of the measuring unit; and providing an indication that theretrieved new measurement position of the measuring unit matches thedetermined position of the measuring unit.

(12) The method of (1), further comprising:

receiving depth information indicating positions in a depth direction;receiving measurement information from the measurement unit, themeasurement information comprising skin image data; and generating athree-dimensional image map based on the received depth information andthe received measurement information.

(13) The method of (1), further comprising: receiving measurementinformation corresponding to different wavelengths of light.

(14) A measuring system for performing a fixed point observationcomprising: an imaging unit comprising at least one image sensor; ameasuring instrument including at least one marker; a position computingunit; a determining unit; and an output controller; wherein the imagingunit is configured to acquire an image comprising a user and the marker,and provide the acquired image to the position computing unit; whereinthe position computing unit is configured to compute a position of themarker with respect to the user based on the image provided by theimaging unit, and further provide the computed position to thedetermining unit; wherein the determining unit is configured todetermine whether the computed position of the marker matches aretrieved measurement position, and further output the result of thedetermination to the output controller; and wherein the outputcontroller is configured to provide an indication when the markerposition matches the measurement position.

(15) The measuring system of (14), further comprising: a useridentifying unit configured to receive an image from the imaging unit,detect one or more features associated with the user, and identify auser based on the detected one or more features; wherein the retrievedmeasurement position is a measurement position associated with theidentified user.

(16) The measuring system of (14), wherein the marker is an LED thatemits at least one of visible light, ultraviolet light and infraredlight.

(17) The measuring system of (14), wherein the marker is a light emitterthat blinks in a predetermined blinking pattern by turning on and off,and the measuring system further comprises a pattern detector thatdetects the blinking pattern of the marker on the basis of whether themarker is on or off in the image.

(18) The measuring system of (17), wherein the measuring instrument isfurther configured to acquire measurement data in response to theretrieved measurement position matching the computed position of theLED.

(19) The measuring system of (18), wherein the measurement datacomprises skin measurement data.

(20) The measuring system of (19), further comprising:

wherein the measuring instrument measures the user's skin by taking animage in close proximity; and the measuring system further comprises: agenerator that, on the basis of a plurality of skin images obtained fromthe measurement unit, generates a full skin image formed by joining theplurality of skin images together.

(21) The measuring system of (14), further comprising an irradiatingunit configured to successively emit light at different wavelengths;wherein the measuring instrument acquires measurement data for eachsuccessive light emission.

(22) The measuring system of (14), further comprising:

acquiring skin measurement data utilizing the measurement instrument.

(23) The measuring system of (14), wherein the measuring instrument isfreely attachable to and detachable from the imaging unit.

(24) The measuring system of (14), further comprising:

an orientation identifying unit that identifies the orientation of themeasuring instrument.

(25) The measuring system of (24), wherein the measuring instrumentincludes a sensor that senses the motion of the measuring instrument,and the orientation identifying unit identifies the orientation of themeasuring instrument on the basis of the sensing results from thesensor.

(26) The measuring system of (25), wherein the marker is a graphicalfigure provided on a case of the measuring instrument; and theorientation identifying unit identifies the orientation of the measuringinstrument on the basis of the shape of the graphical figure in theimage.

(27) A method of performing a fixed point observation comprising:determining a position of a measuring instrument based on an image ofthe measuring instrument; and initiating a measurement by the measuringinstrument when the position of the measuring instrument matches aretrieved measurement position.

(28) The method of performing a fixed point observation according to(27), wherein the measurement by the measuring instrument is skinmeasurement data.

(29) The method of performing a fixed point observation according to(27), wherein the determined position of the measuring instrument isbased on a position of the measuring instrument in an image in relationto a user in the image.

(30) An information processing apparatus including:

an imaging unit that takes an image of a subject, together with a markerprovided on a measuring instrument that measures part of the subjectwhile in close proximity;

a position computing unit that computes a marker position expressing theposition of the marker with respect to the subject, on the basis of theimage obtained from the imaging by the imaging unit; and

a controller that conducts a predetermined controlling process in thecase where the marker position matches a measurement position, themeasurement position being the marker position when measuring part ofthe subject.

(31) The information processing apparatus according to (30), wherein themarker is a light emitter that blinks in a predetermined blinkingpattern by turning on and off, and the information processing apparatusfurther includes: a pattern detector that detects the blinking patternof the marker on the basis of whether the marker is on or off in theimage.

(32) The information processing apparatus according to (31), wherein themarker blinks in a blinking pattern expressing the state of themeasuring instrument, and

the information processing apparatus further includes:

a display controller that causes a display to display the state of themeasuring instrument on the basis of the detection result from thepattern detector.

(33) The information processing apparatus according to (30) to (32),wherein

the controller conducts the predetermined controlling process every timethe marker position matches respective measurement positions on a tracktraced as the measuring instrument moves.

(34) The information processing apparatus according to (30) to (33),wherein

in the case where the marker position matches a measurement position,the controller conducts at least one of a first controlling process thatreports the match to the user, and a second controlling process thatcontrols the measuring instrument and causes the measuring instrument tomeasure part of the subject.

(35) The information processing apparatus according to (30) to (34),further including:

an orientation identifying unit that identifies the orientation of themeasuring instrument. (36) The information processing apparatusaccording to (35), wherein

the measuring instrument includes a sensor that senses the motion of themeasuring instrument, and

the orientation identifying unit identifies the orientation of themeasuring instrument on the basis of the sensing results from thesensor.

(37) The information processing apparatus according to (35), wherein

the marker is a graphical figure provided on the case of the measuringinstrument, and

the orientation identifying unit identifies the orientation of themeasuring instrument on the basis of the shape of the graphical figurein the image.

(38) The information processing apparatus according to (30) to (34),

wherein the measuring instrument measures the subject's skin by takingan image in close proximity, p the information processing apparatusfurther including:

a generator that, on the basis of a plurality of skin images obtainedfrom imaging by the measuring instrument, generates a full skin imageformed by joining the plurality of skin images together.

(39) The information processing apparatus according to (38), furtherincluding:

a distance measuring unit that measures the distances to the measurementpositions; and

a three-dimensional position computing unit that computes thethree-dimensional positions of the skin images on the basis of themeasurement positions and the distances;

wherein the generator generates a full skin image stereoscopicallydisplaying the subject's skin additionally on the basis of thethree-dimensional positions of the plurality of skin images.

(40) The information processing apparatus according to (30) to (34),wherein the measuring instrument includes

an irradiating unit that irradiates part of the subject with light at aplurality of different wavelengths, and

a camera measuring unit that measures part of the subject by taking animage of skin being irradiated with light at a particular wavelength foreach of the plurality of different wavelengths.

(41) The information processing apparatus according to (30) to (34),wherein

the measuring instrument is freely attachable to and detachable from theinformation processing apparatus.

(42) The information processing apparatus according to (41), wherein

the measuring instrument is capable of being electrically rechargedwhile attached to the information processing apparatus.

(43) The information processing apparatus according to (30) to (34),wherein the measuring instrument includes

a camera measuring unit that takes a close-up image of part of thesubject,

a lens barrel, having a cylindrical shape surrounding the camerameasuring unit, and configured to switch on when pushed against part ofthe subject, and

a rotary unit that rotates about the optical axis of the camerameasuring unit according to a rotating operation by the user.

(44) The information processing apparatus according to (43), wherein

the camera measuring unit takes a close-up image of part of the subjectwhen the lens barrel is switched on, and

the rotary unit rotates about the optical axis of the camera measuringunit when switching operating modes related to the operation of thecamera measuring unit.

(45) An information processing method conducted by an informationprocessing apparatus including an imaging unit that takes an image of asubject, together with a marker provided on a measuring instrument thatmeasures part of the subject while in close proximity, the informationprocessing method including:

computing a marker position expressing the position of the marker withrespect to the subject, on the basis of the image obtained from theimaging by the imaging unit; and

conducting a predetermined controlling process in the case where themarker position matches a measurement position, the measurement positionbeing the marker position when measuring part of the subject.

(46) A program executed by a computer in an information processingapparatus including an imaging unit that takes an image of a subject,together with a marker provided on a measuring instrument that measurespart of the subject while in close proximity, the program causing thecomputer to function as:

a position computing unit that computes a marker position expressing theposition of the marker with respect to the subject, on the basis of theimage obtained from the imaging by the imaging unit; and

a controller that conducts a predetermined controlling process in thecase where the marker position matches a measurement position, themeasurement position being the marker position when measuring part ofthe subject.

(47) A measuring system including:

a measuring instrument that takes a measurement while in close proximityto a user; and

an information processing apparatus including an imaging unit that takesan image of the user and the measuring instrument; wherein the measuringinstrument includes

a measuring unit that measures part of the user while in closeproximity, and

a marker provided on the case of the measuring instrument, and theinformation processing apparatus includes

an imaging unit that takes an image of the user, together with themarker provided on the measuring instrument,

a position computing unit that computes a marker position expressing theposition of the marker with respect to the user, on the basis of theimage obtained from the imaging by the imaging unit, and

a controller that conducts a predetermined controlling process in thecase where the marker position matches a measurement position, themeasurement position being the marker position when measuring part ofthe user.

The foregoing series of processing operations may be executed inhardware, and may also be executed in software, for example. In the caseof executing the series of processing operations in software, a programconstituting such software may be installed from a program recordingmedium onto a computer built into special-purpose hardware, oralternatively, onto a computer capable of executing various functions byinstalling various programs thereon, such as a general-purpose personalcomputer, for example.

<Exemplary Configuration of Computer>

FIG. 15 illustrates an exemplary hardware configuration of a computerthat executes the foregoing series of processing operations according toa program.

A central processing unit (CPU) 201 executes various processingoperations according to a program stored in read-only memory (ROM) 202or a storage unit 208. Random access memory (RAM) 203 stores informationsuch as programs executed by the CPU 201 and data as appropriate. TheCPU 201, the ROM 202, and RAM 203 are connected to each other by a bus204.

Additionally, an input/output interface 205 is connected to the CPU 201via the bus 204. Connected to the input/output interface 205 are aninput unit 206 which includes devices such as a keyboard, mouse, andmicrophone, and an output unit 207 which includes devices such as adisplay and one or more speakers. The CPU 201 executes variousprocessing operations in response to commands input from the input unit206. The CPU 201 then outputs processing results to the output unit 207.

A storage unit 208 connected to the input/output interface 205 includesa hard disk, for example, and stores programs executed by the CPU 201and various data. A communication unit 209 communicates with externaldevices via a network such as the Internet or a local area network.

Programs may also be acquired via the communication unit 209 and storedin the storage unit 208.

A drive 210 connected to the input/output interface 205 drives aninserted removable medium 211 such as a magnetic disk, an optical disc,a magneto-optical disc, or semiconductor memory, and acquiresinformation such as programs and data recorded thereon. Acquiredprograms and data are transferred to the storage unit 208 and stored asappropriate.

As illustrated in FIG. 15, a recording medium that records (stores) aprogram to be installed onto a computer in a computer-executable statemay be a removable medium 211 as an instance of packaged media such asmagnetic disks (including flexible disks), optical discs (includingCompact Disc—Read-Only Memory (CD-ROM) and Digital Versatile Disc(DVD)), magneto-optical discs (including Mini-Disc (MD)), orsemiconductor memory. Alternatively, such a recording medium may be theROM 202 in which the program is transiently or permanently stored, orthe hard disk constituting the storage unit 208. The recording of theprogram to the recording medium is conducted using a wired or wirelesscommunication medium such as a local area network, the Internet, ordigital satellite broadcasting via the communication unit 209, which maybe a router, modem, or other interface as appropriate.

Note that, in this specification, the steps describing the foregoingseries of processing operations obviously encompass processingoperations conducted in a time series following the stated order, butalso encompass operations executed in parallel or individually withoutstrictly being processed in a time series.

Also, in this specification, the term “system” denotes the totality ofan apparatus composed of multiple apparatus.

Furthermore, the present disclosure is not limited to the foregoingembodiments, and various modifications are possible within a scope thatdoes not depart from the principal matter of the present disclosure.

The present disclosure contains subject matter related to that disclosedin Japanese Priority Patent Application JP 2012-206838 filed in theJapan Patent Office on Sept. 20, 2012, the entire contents of which arehereby incorporated by reference.

It should be understood by those skilled in the art that variousmodifications, combinations, sub-combinations and alterations may occurdepending on design requirements and other factors insofar as they arewithin the scope of the appended claims or the equivalents thereof.

REFERENCE SIGNS LIST

-   1 Measuring system-   21, 21′, 21″ Measuring instrument-   21 a Camera-   21 b LED-   21 c Communication unit-   21 d Charging connector-   22 Smartphone-   22 a Imaging unit-   22 b LCD-   22 c Power supply connector-   41 Optics-   42 Image sensor-   43 Signal processing IC-   61 User identifying unit-   62 Position computing unit-   63 Determining unit-   63 a Memory-   64 Output controller-   65 Speaker-   66 Display controller-   67 Main controller-   68 Operable unit-   81 Pattern detector-   82 State identifying unit-   83 Display controller-   101 Communication controller-   102 Communication unit-   103 Data storage unit-   141 Lens barrel-   142 Mode switcher

1-29. (canceled)
 30. A measuring device comprising: a light emitterconfigured to emit light having a plurality of wavelengths; an imagingunit configured to receive light reflected by an object and output animage signal; a barrel that houses the imaging unit; and a mode selectorlocated on a side surface of the barrel and configured to select atleast one of a first mode of operation or a second mode of operationbased on a rotated position of the mode selector, wherein the measuringdevice is configured to change from an off-state to an on-stateautomatically in response to depressing the barrel to the object. 31.The measuring device according to claim 29, wherein the object is skinof a user.
 32. The measuring device according to claim 29, wherein theobject is skin of a user's face.
 33. The measuring device according toclaim 1, wherein the imaging unit is configured to output the imagesignal in response to depressing the barrel to the object
 34. Themeasuring device according to claim 33, further comprising a processorconfigured to process the image signal.
 35. The measuring deviceaccording to claim 34, wherein the processor is configured to processthe image signal to output skin data of a user.
 36. The measuring deviceaccording to claim 29, wherein the mode selector is configured to selectthe at least one of the first mode of operation or the second mode ofoperation based on the rotated position of the mode selector withrespect to the barrel.
 37. The measuring device according to claim 29,wherein the first mode of operation is selected in response to rotatingthe mode selector in a first direction.
 38. The measuring deviceaccording to claim 37, wherein the second mode of operation is selectedin response to rotating the mode selector in a second direction that isopposite to the first direction.
 39. The measuring device according toclaim 38, wherein the first mode of operation configures the measuringdevice to measure an object on a first side of a user's body.
 40. Themeasuring device according to claim 29, wherein the mode selector isrotatable about an optical access of the imaging unit.
 41. The measuringdevice according to claim 29, wherein in response to rotating the modeselector in a first direction, a first item is selected.
 42. Themeasuring device according to claim 41, wherein in response to rotatingthe mode selector in a second direction, a second item is selected. 43.The measuring device according to claim 41, wherein the first item isconfirmed in response to depressing the barrel of the measuring device.44. The measuring device according to claim 29, wherein an image of theobject is acquired in response to depressing the barrel to the object.45. The measuring device according to claim 44, wherein in the firstmode of operation, the light emitter is configured to emit visiblelight.
 46. The measuring device according to claim 45, wherein in thesecond mode of operation, the light emitter is configured to emitinfrared light.
 47. The measuring device according to claim 46, whereinin the first mode of operation, the image of the object illuminated bythe visible light is acquired, and in the second mode of operation, theimage of the object illuminated by the infrared light is acquired. 48.The measuring device according to claim 29, wherein a previous mode ofoperation is selected in response to rotating the mode selector in afirst direction.
 49. The measuring device according to claim 48, whereina next mode of operation is selected in response to rotating the modeselector in a second direction that is opposite to the first direction.